[Title of the Invention] 

Mobile device having health care \ function based on biomedical signals and health care 
method using the same 

[Brief Description of the Drawings] 

FIG 1 is a view of a mobile communication terminal with a conventional biomedical 
information measurement module included therein. 

FIG 2 is a block diagram schematically illustrating a mobile device according to the 
present invention. 

FIG 3 is a view showing an interior configuration of a biomedical signal 
measurement module of the mobile device shown in FIG 2. 

FIG 4 is a graph plotting waveforms of EDA signals measured by a skin resistance 
sensor unit of FIG. 3. 

FIG 5 is a view illustrating how to correct user-to-user variation of the EDA signal, 
which is measured through the skin resistance sensor unit of FIG 3. 

FIG 6 is a view showing an embodiment of a mobile device according to the present 
invention. 

FIG 7 is a view illustrating a state where the biomedical signal measurement module 
is separated from the mobile device shown in FIG 6. 

FIG 8 is a view illustrating how to measure biomedical signals using the mobile 
device according to the present invention. 

FIG 9 is a view showing an interior configuration of a health care module shown in 

FIG 2. 

FIG 10 is a view showing an example of a PPG signal to be used in the analysis of a 
heartbeat signal. 

FIG 1 1 is a view showing a detailed configuration of a heartbeat detection unit shown 
in FIG 9. 

FIG 12 is a view showing a process of obtaining time series data of a heart rate from 
a heartbeat signal produced by the heartbeat detection unit shown in FIG 1 1 . 

FIG 13 is a graph showing a waveform of the EDA signal used to detect skin 
conductive response (SCR). 

FIG 14 is a view showing a configuration of an SCR detection unit shown in FIG 9. 



FIG 15 is a view showing a waveform of an SKT signal used to detect changes in 
skin temperature. 

FIG 16 is a block diagram showing a configuration of an SKT Mean/Max calculation 
unit shown in FIG 9. 

FIGS. 17a and 17b are views showing results of emotion classification by an SVM 
classifier shown in FIG 9. 

FIG 18 is a flowchart illustrating a health care method using the mobile device 
according to the present invention. 

FIG 19 is a flowchart specifically illustrating a step of correcting the user-to-user 
variation of biomedical signals shown in FIG 18. 

FIG 20 is a flowchart illustrating a step of managing stress history and providing 
stress information shown in FIG 1 8. 

FIG 21 is a flowchart illustrating a step of managing diet history and providing diet 
information shown in FIG 18. 

FIG 22 shows display screens of the mobile device in a case where a health care 
menu has been selected in the mobile device according to the present invention. 

FIGS. 23a to 23d show display screens of the mobile device in a case where a stress 
manager menu has been selected in the mobile device according to present invention. 

FIGS. 24a to 24e show display screens of the mobile device in a case where a diet 
manager menu has been selected in the mobile device according to the present invention. 

< Descriptions of Reference Numerals of Major Elements of the Drawings> 

50a, 50b, 52a, 52b : electrodes 

100 : biomedical signal measurement module 

150 : sensor unit 170 : sensor control unit 

210 : input unit 220 : display unit 

230 : memory unit 240 : central control unit 

250 : wireless communication unit 260 : interface unit 

300 : health care module 310: feature analysis unit 

311: heartbeat analysis unit 312: heartbeat detection unit 

313 : spectrum analysis unit 314 : Mean/Std calculation unit 

315: SCR analysis unit 316: SCR detection unit 

317: SCR calculation unit 318: SKT Mean/Max calculation unit 

320 : subtracter unit 330 : SVM unit 



332 : SVM classifier 334 : database 

336 : emotional determination unit 350 : emotional state analysis unit 

370 : physical condition analysis unit 371 : body fat percentage calculation unit 

372 : calorie consumption calculation unit 

400 : mobile device 

[Detailed Description of the Invention] 
[Object of the Invention] 

[Field of the Invention and Description of the Related Art] 

The present invention relates to a mobile device capable of performing biomedical 
signal measurement and a health care method using the same. More particularly, the 
present invention relates to a mobile device capable of checking a user's state of health using 
a handheld mobile device mounted with a biomedical signal measurement module, which can 
be used both as a mobile device and in measuring biomedical signals if necessary, and a 
health care method using the same. 

As industrial societies have developed, the modern people have suffered greatly from 
various kinds of adult diseases such as hypertension, corpulence, diabetes and cardiac 
disorders due to stress from heavy workloads and lack of physical exercise, and accordingly, 
the death rate tends to increase every year. Such an increase of adult diseases and the 
resultant death rate allows modern people to gradually pay attention to their own health. 
Thus, devices for allowing their own health state to be examined at any time have been 
actively developed. 

Typical health care devices capable of examining the current state of health of a user 
include blood pressure gauges, thermometers, body fat analyzers, and the like. These 
devices are widely used in a variety of fields for the purpose of medical or non-medical 
treatment. 

However, since most of the blood pressure gauges, thermometers and body fat 
analyzers should be provided with additional devices to check the user's health, they are 
improper for portable use. Due to the inconvenience of carrying these devices, it is difficult 
to perform continuous health care monitoring for users. 

As a device for avoiding such inconvenience of carrying extra devices, a mobile 
communication terminal capable of diagnosing the cardiac function of a user or checking 
their obesity based on heart rate and body fat percentage detected from a user's body is 
disclosed in Korean Patent Laid-Open Publication No. 2002-11730 (publication date: 



February 9, 2002), as shown in FIG. 1. However, the mobile communication terminal 
cannot provide countermeasures for overcoming stress that may be fatal to modern people 
living in a highly competitive society. Furthermore, another device is required for 
managing a user's mental state of health as well as the physical condition of the user. 

[Technical Aspects to be Achieved by the Invention] 

The present invention is conceived to solve the problems in the related art. An object 
of the present invention is to provide a mobile device capable of efficiently performing health 
care functions for a user by checking a user's state of health using a handheld mobile device 
mounted with a biomedical signal measurement module, which is usually used as a mobile 
device and if necessary, in measuring the emotional state and physical condition of a user, 
and a health care method using the same. 

Another object of the present invention is to provide a mobile device capable of 
simply checking the emotional state and physical condition of a user through the user's 
natural action for using a mobile device, and a health care method using the same. 

[Embodiments and Operations of the Invention] 

In order to accomplish the above object, there is provided a mobile device with an 
input unit, a display unit, a memory unit and a central control unit, the mobile device 
according to one embodiment of the present invention comprises a biomedical signal 
measurement module for detecting biomedical signals from a user's body, classifying the 
detected biomedical signals by respective signals and outputting the classified signals; and a 
health care module for analyzing a user's emotional state and physical condition based on the 
classified signals input from the biomedical signal measurement module and user's physical 
information. 

The biomedical signal measurement module is constructed to be detachably coupled 
to the mobile device, and is arranged at a position on which a thumb of the user is placed 
when the user naturally holds the mobile device 4 

The biomedical signal measurement module corrects user-to-user variation of the 
biomedical signals which are detected from the user's body. 

The health care module comprises an emotional state analysis unit for analyzing the 
biomedical signals input from the biomedical signal measurement module and determining 
the user's emotional state; and a physical condition analysis unit for analyzing the user's 
physical condition based on the biomedical signals input from the biomedical signal 



measurement module and the user's physical information. The emotional state analysis unit 
comprises a feature analysis unit for analyzing features of the biomedical signals detected 
from the user's body; a subtracter unit for obtaining differences between the analysis results 
from the feature analysis unit and feature values on the basis of which the user's emotional 
state is determined; and an SVM unit for analyzing the differences of the feature values 
obtained by the subtracter unit, classifying the user's emotional state, and calculating and 
outputting an index and level for a specific emotion among the classified emotions. The 
physical condition analysis unit comprises a body fat percentage calculation unit for 
calculating body fat percentage based on a body impedance value detected by the biomedical 
signal measurement module and user's height, weight, age and sex; and a calorie 
consumption calculation unit for calculating calorie consumption due to exercise based on 
average heart rates and body fat percentages before/after exercise detected by the biomedical 
signal measurement module. 

In order to accomplish the above object, a health care method using a mobile device, 
comprises the steps of selecting, by a user, a health care menu on a mobile device with a 
biomedical signal measurement module; if the user selects emotional state measurement, 
activating the biomedical signal measurement module to detect the biomedical signal in the 
mobile device; detecting at least one biomedical signal from a user's body; analyzing the 
detected biomedical signals and extracting a plurality of feature values to be used for 
determining user's emotional state; calculating differences between the plurality of extracted 
feature values and feature values on which the user's emotional state is determined based; 
classifying the user's emotional state by respective emotions based on SVM classification 
according to the calculated differences of the feature values; and selecting values related to 
an emotion selected among the classified emotions, calculating an emotional state index and 
level for the selected emotion, and displaying the calculated emotional state index and level 
on a display unit of the mobile device. 

Hereinafter, a preferred embodiment of the present invention will be described in 
detail with reference to the accompanying drawings. 

FIG 2 is a block diagram schematically illustrating a configuration of the mobile 
device according to the present invention. As shown in FIG. 2, the mobile device 400 of the 
present invention comprises a biomedical signal measurement module 100, an input unit 210, 
a display unit 220, a memory unit 230, a central control unit 240, and a health care module 
300. The mobile device is configured such that it can be easily used both as a mobile 



device and as a device that can check the state of health of a user, if necessary, through the 
biomedical signal measurement module 100 and the health care module 300. 

The mobile device 400 of the present invention can be used as a wireless 
communication device. In such a case, the mobile device of the present invention further 
comprises a wireless communication unit 250 capable of transmitting and receiving voice 
and characters by radio. Therefore, it can be understood in the embodiment of the present 
invention that the mobile device 400 can be any of the following, or similar, portable 
electronic equipment such as PDA (Personal Digital Assistants), Palm-Top PC, handheld PC, 
PCS (Personal Communication Service) phone, cellular phone, and IMT-2000 terminal. 

Further, other external devices can be used with and connected to the mobile device 
400 of the present invention. In such a case, the mobile device 400 can further include an 
interface unit 260 for transmitting and receiving data to and from external devices. 

The biomedical signal measurement module 100 includes a sensor unit 150 for 
detecting one or more biomedical signals from the body of a user, and a sensor control unit 
170 for controlling the sensor unit 150 or classifying and outputting the biomedical signals 
input from the sensor unit 150. 

The input unit 210 is used to input numbers, symbols and characters such as the 
Korean and English alphabets through a keypad, scroll buttons, numeric pad and the like. 
At this time, the user can use a variety of functions such as the input of numerals and 
symbols of telephone numbers, and start and completion of a telephone call, through the 
input unit 210, when intending to use the mobile device as it is. Furthermore, the user can 
input his/her height, weight, age, sex, and the like through the input unit 210 when intending 
to use the mobile device as a health care device. 

The display unit 220 displays either numbers/characters the user inputs or biomedical 
signal data of the user measured from the biomedical signal measurement module 100 onto a 
screen. 

The memory unit 230 stores information on the user's body, directions for use of the 
mobile device, and general health information in addition to a variety of data including 
telephone numbers. 

The central control unit 240 controls an overall operation of the mobile device 400. 
That is, the central control unit 240 measures biomedical signals through the biomedical 
signal measurement module 100 if necessary, and then analyzes the measured biomedical 
signal using the health care module 300 so as to check the state of health of the user. 



The wireless communication unit 250 functions to transmit and receive voice and 
character data by radio and has the same constitution and operation as that used generally in 
the field of wireless communication terminals. Therefore, a detailed description thereof will 
be omitted. 

The interface unit 260 receives data from external devices connected to the mobile 
device and outputs the input data to the central control unit 240, and functions to output the 
biomedical signals from the user input by the biomedical signal measurement module 100 to 
the central control unit 240 in a case where the biomedical signal measurement module 100 
is mounted to the mobile device. At this time, the interface unit 260 transmits and receives 
the signal to and from the biomedical signal measurement module 100 through the use of a 
communication protocol such as RS232C. This is merely an example of a signal 
transmission method, and a variety of communication protocols can be used depending on 
the circuit configuration. 

The configuration of the biomedical signal measurement module 100 will be more 
specifically explained with reference to FIG.3. 

FIG 3 shows an interior configuration of the biomedical signal measurement module 
100 shown in FIG 2. As shown in FIG 3, the biomedical signal measurement module 100 
includes the sensor unit 150 for detecting one or more biomedical signals from the body of a 
user, and the sensor control unit 170 for controlling the sensor unit 150 or classifying and 
outputting the biomedical signals input from the sensor unit 150. 

Generally, in a stable mental state, a user's heartbeat becomes slow and peripheral 
blood vessels are expanded. Therefore, the user's body temperature at the skin and thus 
skin resistance are increased. However, if the user is excited or subjected to stress, the 
heartbeat becomes fast and the blood moves from the skin to muscles. Therefore, the user's 
body temperature and thus the skin resistance tend to be decreased. Consequently, such 
changes in heartbeat, skin temperature and skin resistance are deemed to be an important 
factor for determining the stress level of the user. 

In the embodiment of the present invention, accordingly, the heartbeat, skin 
temperature and skin resistance, which quickly respond to the user's skin according to an 
emotional change, are measured in order to check the stress level of the user. To this end, 
the sensor unit 150 of the biomedical signal measurement module 100 includes a heart rate 
sensor 110 for detecting a biomedical signal for heartbeat, a skin temperature sensor 120 for 
detecting a biomedical signal for skin temperature, and a skin resistance sensor 130 for 
detecting a biomedical signal for skin resistance. 



In the embodiment of the present invention, it is preferred that the heartbeat sensor 
include a PPG (photoelectric pulse plethysmograph) sensor 111 for measuring changes in 
blood flow according to a change in the thickness of blood vessel due to the heartbeat. It is 
also preferred that the skin temperature sensor 120 include an SKT sensor 121 such as a 
thermistor for measuring skin temperature (SKT) as a resistance value that changes in 
response to temperature change. Further, it is preferred that the skin resistance sensor 130 
include an EDA (electrodermal activity) sensor 131 for measuring skin resistance that 
changes under the influence of sweat eliminated from the skin by using an electrode directly 
or indirectly in contact with the skin and a comparator connected with the electrode. 
Preferably, the skin resistance sensor 130 may include a galvanic skin resistance (GSR) 
sensor for measuring galvanic skin resistance instead of the EDA sensor. 

According to a preferred embodiment of the present invention, the heart rate sensor 
110, the skin temperature sensor 120 and the skin resistance sensor 130 include filters 112, 
122 and 132 for filtering the detected biomedical signals and amplifiers 113, 123 and 133 for 
amplifying the filtered biomedical signals, respectively. 

In the meantime, since user-to-user variation in biomedical signals detected through 
the sensor unit 150 largely changes depending on response sensitivity and measuring 
environment, the stress level of the user may not be measured exactly. 

Specifically, a nickel electrode is employed in the EDA sensor 131 of the skin 
resistance sensor 130 so that skin resistance Rh of the user can be measured for a long time. 
In such cases, the nickel electrode has an advantage in that it is superior to conventional 
Ag/AgCl electrodes in view of their durability, but has a problem in that user-to-user 
variation in a DC value of the skin resistance Rh detected through the nickel electrode is 
increased. As shown in FIG. 4, for example, it is assumed that a person A has a dry skin of 
which skin resistance Rh is between 1.5 ~ 2.0 Mfi whereas a person B has wet and sweaty 
skin of which skin resistance Rh is between 0.5 ~ 1.0 Mfi. Therefore, if there is such 
variation in the skin resistance Rh, it is deemed that the emotional state of the user is not 
properly reflected. Accordingly, it is necessary to correct user-to-user variation in skin 
resistance during the initialization stage of measurement. 

To this end, the sensor control unit 170 of the biomedical signal measurement module 
100 corrects user-to-user variation in skin resistance by decreasing or increasing the gain of 
the amplifier 133 according to the voltage value Vo output from the EDA sensor 131 through 
the amplifier 133. Hereinafter, the variation correction of the sensor control unit 170 will be 
explained in detail with reference to FIG 5. 



As shown in FIG 5, assuming that an electric current measured in the EDA sensor 
131 is i, the skin resistance of the user is Rh and variable resistance for controlling the gain of 
the amplifier 133 is R, the voltage value Vo input into the sensor control unit 170 can be 
expressed as the following formula. 

V 0 =(R h +R)xi = (R h xi) + (Rxi), 

where (R h xi) = 0.5V . 

The above formula can also be expressed as follows: 
V 0 = 0.5 + 0.5 k— 

Therefore, the relationship V 0 oc R is satisfied. That is, the voltage value Vo input 
into the sensor control unit 170 is proportional to the value R of the variable resistor. 
Accordingly, the voltage Vo is decreased as the resistance value R of the variable resistor is 
decreased, whereas the voltage Vo is increased as the value R of the variable resistor is 
increased. 

In accordance with this principle, when the input voltage value Vo is equal to or 
greater than an upper limit voltage, the sensor control unit 170 reduces the value R of the 
variable resistor and thus the gain of the amplifier 133, thereby reducing the voltage V 0 . On 
the other hand, when the input voltage V 0 is equal to or less than a lower limit voltage, the 
sensor control unit 170 increases the value R of the variable resistor and thus the gain of the 
amplifier 133, thereby increasing the voltage value Vo. 

Accordingly, the voltage value Vo output from the amplifier 133 can be maintained 
between the lower limit voltage and the upper limit voltage by means of the correction of the 
sensor control unit 170 for the user-to-user variation. Consequently, the biomedical signal 
onto which variation in the emotional state of the user is properly reflected can be detected. 

Although heartbeat, temperature and skin resistance as response factors for 
determining the emotional state of a user have been measured in the embodiment of the 
present invention, any one or two factors of these biomedical signals may be measured. 
However, it is preferred that all the three factors be measured in order to determine the 
emotional state of the user more accurately. 

Referring again to FIG 3, the sensor unit 150 of the biomedical signal measurement 
module 100 further includes a body fat sensor unit 140 for measuring body impedance 
necessary to calculate body fat percentage so as to measure the body fat of the user. 

The body fat percentage is referred to as a percentage of fat in the body. 
Appropriate body fat is essentially required for protecting body organs, shielding heat from 



being emitted, and maintaining body temperature. However, excessive body fat hinders 
smooth metabolism, and thus, becomes a primary factor for increasing aging phenomena and 
diseases of adult people such as hyperlipemia, sclerosis of the arteries, hypertension, and 
diabetes. Accordingly, it is very important to keep the body fat percentage at an appropriate 
level in order to preserve the user's health. 

The body fat sensor unit 140 includes an impedance sensor 141 for measuring body 
impedance by causing a small alternating current to flow through the electrode in contact 
with the body surface of the user and then measuring the voltage between both ends of the 
electrode. Body impedance measured by the impedance sensor 141 is first amplified by a 
first amplifier 142, is then filtered through a filter 143, and is again amplified by a second 
amplifier 144. Thereafter, the body impedance is input into the sensor control unit 170. 

The body fat percentage can be calculated according to the impedance method based 
on the body impedance measured in the body fat sensor 140 and information on the user's 
body (sex, age, height, weight). The impedance method is a method of measuring electrical 
resistance in the body and thus calculating body fat percentage based on the principle that 
electricity flows easily through fat-free tissues of the body since fat-free tissues contain a 
great deal of moisture (72-73% including electrolyte), whereas fat tissues are insulated so 
electricity does not flow through fat tissues since fat tissues contain significantly less 
moisture. 

Furthermore, it is preferred that the biomedical signal measurement module 1 00 be 
configured such that it can be efficiently carried and easily used for measurement. 
Hereinafter, a process of implementing the biomedical signal measurement module 100 will 
be explained in detail with reference to FIGS. 6 to 8. 

FIG 6 is a view showing an embodiment of the mobile device according to the 
present invention. FIG. 7 is a view illustrating a state where the biomedical signal 
measurement module is separated from the mobile device shown in FIG. 6. FIG. 8 is a view 
illustrating how to measure biomedical signals using the mobile device according to the 
present invention. 

It is preferred that the biomedical signal measurement module 100 be configured to 
be detachably mounted to the mobile device so that it can be easily carried by the user. For 
example, the module 100 may be configured in the form of a case with a receiving space in 
which the mobile device can be accommodated as shown in FIGS. 6 and 7. 

In case of a case-shaped biomedical signal measurement module 100, it is preferred 
that a whole external appearance of the biomedical signal measurement module 100 be a 



shape corresponding to that of the mobile device and a front portion thereof is open such that 
the display unit 220 can be exposed outwardly. When the mobile device is inserted into the 
case-shaped biomedical signal measurement module 100, the mobile device is firmly 
engaged with the biomedical signal measurement module 100 while they are electrically 
connected with each other through the interface unit 260. 

In addition, the biomedical signal measurement module 100 may be configured in the 
form of an additional necklace and be detachably mounted to the mobile device. 
Alternatively, the biomedical signal measurement module 100 may be configured to be fully 
housed in the mobile device. 

As shown in FIGS. 7 and 8, it is preferred that the PPG sensor unit 111 of the 
biomedical signal measurement module 100 be arranged at a position on which a thumb of 
the user is placed when the user naturally holds the mobile device 400, the SKT sensor 121 
thereof be arranged at a position where an index or middle finger would be placed, and the 
EDA sensor 131 thereof be arranged at a position just below the PPG sensor 111 and the SKT 
sensor 121, that is, positions where lower portions of the thumb and index or middle finger 
are placed when the user naturally holds the mobile device 400, such that the biomedical 
signal measurement module 100 can be efficiently utilized for measurement. Further, it is 
preferred that two electrodes of the impedance sensor 141 are installed at a rear side of the 
biomedical signal measurement module 100 and the other two electrodes are installed at a 
front side of the biomedical signal measurement module 100 so that the two rear electrodes 
are in contact with the palm of the user and the two front electrodes are in contact with the 
fingers (e.g., index or middle finger) when the user holds the mobile device 400. 

Therefore, since the fingers or palm of the user can be in contact with the PPG sensor 
111, the SKT sensor 121, the EDA sensor 131 and the impedance sensor 141 whenever the 
user merely holds the mobile device 400, the biomedical signals of the user can be 
conveniently detected through a natural holding action of the user. 

Referring again to FIG 2, the health care module 300 functions to analyze the 
emotional and physical condition of the user based on information on the user's body and the 
biomedical signal data input from the biomedical signal measurement module 100. The 
health care module 300 will be hereinafter explained in detail with reference to FIG 9. 

FIG 9 shows an interior configuration of the health care module 300 shown in FIG. 2. 
As shown in FIG 9, the health care module 300 comprises an emotional state analysis unit 
350 and a physical condition analysis unit 370 for analyzing the emotional and physical 
condition of the user, respectively, based on the biomedical signal data input from the 



biomedical signal measurement module 100 and the information on the user's body stored in 
the memory unit 230. 

The emotional state analysis unit 350 functions to analyze features of the biomedical 
signals measured from the user's body, recognizing emotions based on values between the 
analysis results and the features representing the user's normal emotion, and then outputting 
a stress index and level based on the recognized emotion. Such an emotional recognition 
algorithm is specifically described in Korean Patent Application No. 2002-3868 (entitled 
"device and method for recognizing a user's emotion through short monitoring of 
physiological signals") and will be explained briefly for easy understanding of the present 
invention. 

The emotional state analysis unit 350 includes a feature analysis unit 310 for 
analyzing the features of the biomedical signals measured by the biomedical signal 
measurement module 100, a subtracter unit 320 for calculating a difference value between 
the results analyzed in the feature analysis unit and the features representing the user's 
normal emotion, and a support vector machine (SVM) unit 330 for classifying the emotional 
states according to the analyzed difference between the features calculated in the subtracter 
unit 320 and outputting the calculated index and level for the selected emotional state among 
the classified emotional states. 

The feature analysis unit 310 includes a heartbeat analysis unit 311 for receiving PPG 
signals, detecting the heartbeat and extracting the feature values related to the heartbeat, a 
skin conductive response (SCR) analysis unit 315 for receiving the EDA signals and 
extracting feature values related to SCR, and an SKT Mean/Max calculation unit 318 for 
receiving the EDA signals and extracting feature values related to SKT (i.e., mean (Mean) 
and maximum value (Max) of SKT). 

The heartbeat analysis unit 311 includes a heartbeat detection unit 312 for receiving 
the PPG signals and detecting the heartbeat, a spectrum analysis unit 313 for analyzing the 
spectrum of the detected heartbeat signal (Det), and a Mean/Std calculation unit 314 for 
calculating the mean (Mean) and standard deviation (Std) of the detected heartbeat signal 
(Det). In addition, the SCR analysis unit 315 includes an SCR detection unit 316 for 
receiving EDA signals and detecting SCR, and an SCR calculation unit 317 for calculating 
parameters such as amplitude of SCR. 

FIG 10 is a view showing a detailed configuration of a heartbeat detection unit 312 
shown in FIG. 9, and FIG 1 1 is a view showing an example of the PPG signal to be used in 
the analysis of the heartbeat signal. 



As shown in FIG 11, the heartbeat detection unit 312 of the present invention 
includes a band pass filter 340, a median filter 341, an adder 342, a matched filter 343, and a 
zero clipper 344. 

The band pass filter 340 extracts signals falling within a specific band of the PPG 
signal when the PPG signal is input. The median filter 341 removes noise existing in the 
band-pass filtered signal. The adder 342 adds a reciprocal number of the median filtered 
result to the band pass filtered result and calculates the difference between the two filtered 
results. The difference calculated through the adder 342 is input to the matched filter 343 to 
extract a specific signal (i.e., heartbeat signal) included in the PPG signal. The specific 
signal extracted from the matched filter 343 is subjected to a zero clipping process in the zero 
clipper 344 and is then output as the heartbeat signal (Pet). Here, parameters of the 
matched filter 343 can be updated, if necessary. With a heartbeat detection unit 312 
constructed as such, the PPG signal corresponding to portions indicated by arrows shown in 
FIG 1 1 are extracted as the heartbeat signal (Det). 

FIG 12 is a view showing a process of obtaining time series data of heart rate 
variability from a heartbeat signal produced by the heartbeat detection unit 312 shown in FIG 
11. 

Referring to FIG 12, if an obtained PPG signal 1200 is magnified, a waveform such 
as a waveform 1210 is illustrated. The PPG signal is shown to have periodic pulses 
designated by reference numeral 1210, each of which represents a QRS waveform composed 
of a maximum portion R and minimum portions Q and S located to the right and left of the 
maximum portion R, respectively. 

Portions indicated by arrows among the waveform 1210 shown in FIG 12 become an 
R waveform corresponding to the maximum portion of the heartbeat signal, and they are 
extracted through the heartbeat detection unit 312 shown in FIG 10 to illustrate an R-R 
instantaneous waveform 1230 of the PPG signal. If a moving average interpolation is 
applied to the R-R instantaneous waveform 1230, time series data of heart rate variability 
(HRV) such as 1250 are extracted. A method of obtaining time series data 1250 of such 
heart rate variability is disclosed in the technical paper "An efficient algorithm for the 
spectral analysis of heart rate variability" by R. D. Berger etc. IEEE Trans. Biomed. Eng., vol. 
33, 1986. The heart rate variability (HRV) signal becomes an index that can be used to 
quantitatively determine the degree of activation of sympathetic and parasympathetic systems. 

Referring again to FIG 9, the heartbeat signal (Det) obtained by the heartbeat 
detection unit 312 shown in FIG 10 is transformed into a time series of heart rate variability 



(HRV) by means of the method illustrated in FIG 12, and is then input into the spectrum 
analysis unit 313 and the Mean/Std calculation unit 314. 

The spectrum analysis unit 313 estimates various orders of autoregressive (AR), 
moving average (MA), and autoregressive moving average (ARMA) models for the given 
time series, selects an optimal time series model by choosing a specific order of a specific 
model of which an index for representing estimated error can be minimized, and analyzes the 
spectrum of heart rate variability (HRV) using an ARMAsel algorithm for obtaining the 
spectrum from the selected optimal model. A method of estimating an index for an 
estimated error and a time series model is specifically described in the technical paper "Fact 
and fiction in spectral analysis" by R M. T. Broersen, IEEE Transactions on instrumentation 
and measurement, vol. 49, no. 4, pp. 766-772, 2000. 

The frequency domain parameters of such heart rate variability (HRV) have been 
studied as an important index in many previous research efforts, and are also a very 
important index in biopsychology research. 

The spectrum analysis unit 313 of the present invention analyzes the spectrum of 
heart rate variability (HRV) through signal observation for a short time of about 50 seconds 
by using the ARMAsel algorithm instead of a conventional periodogram method for long- 
term signals ranging from a few minutes to 24 hours. The results analyzed by the spectrum 
analysis unit 313 are transmitted to the subtracter unit 320 as feature values for determining 
the emotional state of the user. 

Further, the Mean/Std calculation unit 314, which has received the time series signal 
of heart rate variability (HRV) from the heartbeat detection unit 312, calculates the mean 
(Mean) and standard deviation (Std) for the given time series and transmits the calculated 
values to the subtracter unit 320 as feature values for determining the emotional state of the 
user. 

Next, the detailed configuration and operation of the SCR analysis unit 315 included 
in the feature analysis unit 310 of FIG. 9 will be explained as follows. 

FIG 13 is a graph showing the waveform of an EDA signal used to detect skin 
conductive response (SCR). FIG 13 shows the waveform 1600 of an EDA signal generated 
from the user and an enlarged waveform 1610 for a portion of the EDA signal waveform 
1600 from which SCR features are extracted. The signals indicated by 1600 and 1610 are 
input into the SCR detection unit 316 of the SCR analysis unit 315. 

FIG 14 is a view showing a configuration of the SCR detection unit 316 shown in 

FIG 9. 



Referring to FIG 14, the SCR detection unit 316 for receiving EDA signals and 
detecting skin conductive response (SCR) includes a down-sampler 345, a differentiator 346, 
and a smoothing convolution unit 347. 

The down-sampler 345 causes the input EDA signal to be down sampled to 10-12 
data. The differentiator 346 differentiates the down sampled result, and the smoothing 
convolution unit 347 performs the smoothing convolution for the differentiated results using 
a Bartlett window with a length of 20. Such an SCR detection unit 316 causes the input 
EDA signal to be output in the form of discrete SCR data. 

The discrete SCR data acquired by the SCR detection unit 316 is input to the SCR 
calculation unit 317 included in the SCR analysis unit 315 so that feature values such as the 
frequency of SCR for a predetermined period of time, SCR amplitude and SCR rise time can 
be produced. The SCR feature data (i.e., the frequency of SCR, the SCR amplitude, the 
SCR rise time, etc.) obtained by the SCR calculation unit 317 are input to the subtracter unit 
320, as shown in FIG. 9. 

Furthermore, a detailed configuration and operation of the SKT Mean/Max 
calculation unit 318 of the feature analysis unit 310 shown in FIG 9 will be discussed as 
follows. 

FIG 15 is a view showing the waveform of an SKT signal used to detect changes in 
skin temperature, and FIG 16 is a block diagram showing the configuration of the SKT 
Mean/Max calculation unit shown in FIG 9. 

Referring to FIG 16, the SKT Mean/Max calculation unit 318 comprises a down- 
sampler 348 and a Mean/Max calculator 349. The SKT Mean/Max calculation unit 318 
receives an SKT signal such as shown in FIG 15 and causes the received signal to be down 
sampled to about 100 data. Then, a mean Mean_SKT and a maximum value MaxSKT of 
the down-sampled data are produced as SKT feature data. 

As described above, the feature values necessary to recognize the user's emotion are 
extracted from the plurality of biomedical signals input from the user by means of the 
heartbeat analysis unit 311, the SCR analysis unit 315 and the SKT Mean/Max calculation 
unit 318 included in the feature analysis unit 310, and then input sequentially into the 
subtracter unit 320 and the SVM unit 330 so that the user's emotion can be recognized. 

Referring again to FIG 9, the feature values Feature F~ Feature 4' for the normal 
emotional state of the user are stored in the subtracter unit 320 as standard feature values for 
recognition of the user's emotion. The subtracter unit 320 calculates the difference between 
a plurality of the feature values Feature 1 ~ Feature 4 input from the heartbeat analysis unit 



311, the SCR analysis unit 315 and the SKT Mean/Max calculation unit 318 included in the 
feature analysis unit 310 and the feature values Feature V ~ Feature 4' for the normal 
emotional state of the user, and then, transmits the difference to the SVM unit 330. 

The SVM unit 330 comprises a support vector machine (SVM) classifier 332 for 
training and classifying the emotional state of the user in response to the difference between 
the feature values output from the subtracter unit 320, a database 334 for storing the results 
obtained by the SVM classifier 332, and an emotional determination unit 336 for determining 
and outputting the stress index and level among the plurality of emotional state values 
classified by the SVM classifier 332. 

If a specific vector for representing a specific emotional state is generally expressed 
as one probability distribution in a multidimensional space and a probability density 
functions corresponding to the respective state are already known, a pattern classifier such as 
the SVM classifier 332 used for classifying the user's emotion may be a statistically optimal 
classifier according to Bayes' law as explained in "Pattern classification", 2nd edition, 2000, 
published from Wiley by R. O. Duda, P. E. Hart and D. G. Stock. 

However, since probability density functions cannot in fact be correctly known, a 
Parzen window classifier, a multilayer perceptron and the like for implicitly implementing 
Bayes' law through training with a limited amount of data are frequently used. But, the 
classifiers have poor generalization characteristics; a very high malfunction rate is obtained 
when using new data that have not yet been used in the training. Moreover, conventional 
pattern classifiers have wide a distribution for feature vectors and there are large overlapping 
portions between different state distributions. Thus, it is very likely that the malfunction 
rate will be increased. In order to solve the above problems, the present invention uses the 
SVM classifier 332, which is known for showing superior generalization characteristics, as a 
pattern classifier for use in emotion recognition. 

Improvement on linear separation possibilities of the SVM classifier 332 can be 
obtained by means of multidimensional nonlinear mapping. The SVM classifier 332 is 
configured using a method for implementing a linear separator having an optimum 
generalization performance based on the statistical learning theory of Vapnik. A more 
detailed description is disclosed in the technical paper, "An overview of statistical learning 
theory", IEEE Transactions on neural network, Vol. 10, No. 5, pp. 988-999, 1999, by V 
Vapnik. 

FIGS. 17a and 17b are views showing emotion classification results made by an SVM 
classifier shown in FIG 9. The SVM classifier 332 of the present invention linearly 



projects and analyzes a nonlinearly high order of input space in a feature space, and presents 
an optimal boundary (i.e., an optimal separating surface) between the feature data (i.e., the 
user's emotions) as shown in FIGS. 17a and 17b. 

Referring again to FIG 9, the emotion classification results obtained by the SVM 
classifier 332 are classified according to the respective emotions, and respective emotion 
intensities are then output in the form of numbers. For example, emotion intensities such as 
0.3 (or 30%) corresponding to stress, 0.6 (or 60%) corresponding to sadness, and 0.1 (or 
10%) corresponding to anger may be expressed in the form of numbers. 

The emotional determination unit 336 receives intensity values for the plurality of 
emotions from the SVM classifier 332, determines which value corresponds to the stress 
index and value among the intensity values, and outputs the determined value. At this time, 
information on what kind of emotions should be recognized in response to the specific input 
feature values is stored in the database 334. Data updates on the database 334 are 
performed during the training of the SVM classifier 332. Once the training of the SVM 
classifier has been completed, data updates on the database 334 are not performed any longer. 
Therefore, the database 334 is necessary for the developer, but the completely developed 
emotion recognition system need not be provided with the database 334. 

The results of emotion recognition performed by the SVM classifier 332 include 
delight, sadness, anger, fear, disgust, and surprise. The embodiment of the present invention 
is configured in such a manner that only the state values of the stress corresponding to an 
indicator of mental health are output through the emotional determination unit 336 so that 
only physical fatigue or mental stress can be determined. Of course, other embodiments of 
the present invention may be configured in such a manner that state values for a variety of 
emotional states such as delight, sadness, anger, fear, disgust, and surprise are output to 
determine the emotional state of the user. 

Furthermore, the physical condition analysis unit 370 includes a body fat percentage 
calculation unit 371 and a calorie consumption calculation unit 372. The body fat 
percentage calculation unit 371 calculates body fat percentage based on the information 
stored in the memory unit 230, such as the height, weight, age and sex of the user, and the 
body impedance values detected through the body fat sensor unit 140 and displays the 
calculated value onto the screen through the display unit 220. 

In the meantime, if the people take exercise, the body temperature and heart rate will 
be raised due to increases in blood flow, and the calories in the body will be consumed. 
Calorie consumption due to a rise in the body temperature and heart rate should be optimal 



since optimal calorie consumption causes the body homeostasis and thus the user's health to 
be kept constant. Accordingly, the calorie consumption calculation unit 372 calculates 
calorie consumption due to exercise based on the body fat percentage and average heart rate 
before/after exercising, and displays the calculated value on the screen through the display 
unit 220. At this time, a value obtained by analyzing the PPG signal measured in the heart 
rate sensor 110 of the biomedical signal measurement module 100, i.e. the average heart rate 
analyzed in the heartbeat analysis unit 311, is used as an average heart rate before/after 
exercise, a value obtained by analyzing the body impedance measured by the body fat sensor 
unit 140 of the biomedical signal measurement module 100, i.e. the body fat percentage 
calculated in percent fat by the body calculation unit 371, is used as body fat percentage. 

Hereinafter, a health care method using the mobile device according to the present 
invention will be described in detail with reference to the accompanying drawings. 

FIG 18 is a flowchart illustrating the health care method using the mobile device 
according to the present invention. 

When a user first selects a health care menu on the mobile device 400, a health care 
main screen is displayed on the display unit 220, as shown in FIG. 22 (S10). In this state, 
the user chooses his/her own profile, as shown in FIG 22b (S20). 

At this time, if there is no user's profile, the user can also directly input data such as 
user's name, height, weight, sex and age to create a user's profile, as shown in FIG 22c. 

Then, if the user selects a stress manager menu, a stress manager main screen is 
displayed on the display unit, as shown in FIG. 23 (S30 and S40). In this state, if the user 
selects a stress measurement menu, a guide message for biomedical signal measurement is 
displayed on the display unit arid the biomedical signal measurement module 100 is 
simultaneously activated, as shown in FIG 23b (S50 and S60). 

Subsequently, when the user presses the start button according to the guide message 
while holding the mobile device 400, a plurality of biomedical signals such as heartbeat, skin 
temperature and skin resistance are detected from a user's body through the biomedical 
signal measurement module 100, and the detected biomedical signals are displayed on the 
display unit so that the user can confirm the results, as shown in FIG. 23b (S70). A status 
window for indicating a ratio of completion of biomedical signal measurement may be 
displayed on the display unit. 

In the meantime, since the user-to-user variation of the biomedical signals measured 
through the biomedical signal measurement module 100 large according to response 
sensitivity and measurement environment, there may be cases where the emotional state of 



the user cannot be correctly determined due to the variation. To this end, the user-to-user 
variation is corrected in an initial measurement stage (S80). The step of correcting the user- 
to-user variance of the biomedical signals S80 will be described hereinafter in greater detail 
with reference to FIG 19. 

As described above with reference to FIGS. 4 and 5, since the user-to-user variation 
of skin resistance values of the biomedical signals measured through the biomedical signal 
measurement module 100 is large, the following description will be focused on skin 
resistance values. 

First, it is determined whether user's body is in contact with the biomedical signal 
measurement module 100, by checking whether a voltage value V0 input from the skin 
resistance sensor 130 of the biomedical signal measurement module 100 is larger than a 
threshold voltage value Vth (S81). Here, the threshold voltage value Vth is a minimum 
voltage value, which indicates that the user's body is in contact with the biomedical signal 
measurement module 100. It is preferred that the threshold voltage value Vth be stored 
beforehand in the memory unit 230. 

If it is determined that the user's body is in contact with the biomedical signal 
measurement module 100, i.e. Vo ^ Vth, it is checked whether the input voltage value Vo is 
equal to or larger than a lower limit voltage Vcutoffjnin but equal to or smaller than a upper 
limit voltage Vcutoffjnax, i.e. Vcutoffjnin < V 0 ^ Vcutoffjnax. Based on the check 
result, it is determined whether correction of the user-to-user variation of skin resistance 
values is required (S82). 

If it is determined that variation correction is required, i.e. Vcutoffjnin < Vo ^ 
Vcutoffjnax is not established, it is checked whether the input voltage value V 0 is above the 
upper limit voltage Vcutoffjnax (S83). If it is above the upper limit voltage Vcutoffjnax, 
the resistance value R of the variable resistor is reduced to decrease the gain of the amplifier 
133 (S84). 

If the input voltage value V 0 is equal to or less than the upper limit voltage 
Vcutoffjnax, it is checked whether the input voltage value Vo is smaller than the lower limit 
voltage Vcutoffjnin (S85). If it is smaller than the lower limit voltage Vcutoffjnin, the 
resistance value R of the variable resistor is increased to increase the gain of the amplifier 
133 (S86). 

The voltage value Vo input from the skin resistance sensor 130 through the step of 
correcting the user-to-user variation can be maintained to be equal to or larger than the lower 
limit voltage but equal to or smaller than the upper limit voltage. Accordingly, correct 



biomedical signals on which a change in the emotional state of the user is properly reflected 
can be detected by correcting the user-to-user variation according to response sensitivity and 
measurement environment. 

After the user-to-user variation correction of the biomedical signals is completed, the 
health care module 300 analyzes the biomedical signals such as the PPG signals, EDA 
signals, and SKT signals detected from the user's body and extracts a plurality of feature 
values used for determining the emotional state of the user (S90). 

As for the feature values extracted in step S90, there are a spectrum of heartbeat 
signals extracted from PPG signals, a mean value and standard deviation value of heartbeat 
signals, SCR-related parameters detected from EDA signals, mean and maximum values 
extracted from SKT signals, and the like. 

Then, differences between the plurality of extracted feature values and feature values 
on which the emotional state is determined based are calculated (SI 00). Here, the feature 
values on which the emotional state is determined based are feature values indicating a 
normal emotional state in which the user is not biased toward a specific emotion. It is 
preferred that the feature values on which the emotional state is determined based be stored 
in advance. 

When the differences between the feature values are obtained, the emotional state of 
the user is determined based on the SVM classification according to the differences. The 
emotional state of the user is first classified by respective emotions and stress-related values 
are then selected from the respective emotions so as to calculate a stress index and level 
(SI 10). 

The calculated stress index and level are displayed on the display unit as shown in 
FIG 23b so that the user can check them (SI 20). In this state, the user may add a comment 
on a situation causing the stress or check the stress status on a daily, weekly or monthly basis. 

Meanwhile, a case where the user selects a stress history management menu or stress 
information menu on the stress manager main screen of FIG. 23a will be described with 
reference to FIG 20. 

If the user selects the stress history management menu on the stress manager main 
screen, the stress history management screen is displayed as shown in FIG 23c (SI 30 and 
SI 40). In this state, if the user selects a desired term, a stress history is displayed on the 
display unit according to the selected term (SI 50 and SI 60). In the state where the stress 
history is displayed on the display unit, if the user selects a comment on a specific date, the 
selected comment is displayed on the display unit (SI 70 and SI 80). 



On the other hand, if the user selects the stress information menu on the stress 
manager main screen, information on stress is displayed on the display unit as shown in FIG 
23d (SI 90 and S200). 

The emotional state determination method of the present invention observes and 
analyzes the biomedical signals for a short period of time of about 50 seconds by using the 
ARMAsel algorithm instead of the conventional periodogram method that is performed for 
signals over a long period of time from a few minutes to 24 hours. Further, upon 
determination of the user's emotional state, the determination is performed by using the SVM 
classifier that exhibits high generalization characteristics. Therefore, the biomedical signals 
of the user can be monitored for a short period of time and the emotional state of the user can 
be correctly recognized. 

Referring again to FIG. 18, if the user selects the diet manager menu on the health 
care main screen, a diet manager main screen is displayed on the display unit as shown in 
FIG 24a (S210). 

If the user selects the body fat measurement menu in this state, the body fat sensor 
140 of the biomedical signal measurement module 100 is activated while a guide message for 
body fat measurement is displayed on the display unit as shown in FIG 24b (S220 and S230). 

When the user presses the measurement start button according to the guide message 
while holding the mobile device 400, a body impedance value is measured from the user's 
body through the body fat sensor 140, and the measured body impedance value is displayed 
on the display unit as shown in FIG 24b so that the user can confirm the measurement result 
(S240). At this time, the status window for indicating the ratio of completion of biomedical 
signal measurement may also be displayed on the display unit. 

Then, body fat percentage BodyFat % of the user's body is calculated based on the 
measured impedance value and the user's height, weight, age and sex stored in the memory 
unit 230, and the calculated body fat percentage is displayed on the display unit as shown in 
FIG 24b (S250 and S260). At this time, the body fat percentage BodyFat % is expressed as 
the following Eq. 1 that is a function of the measured body impedance value R and the user's 
height, weight, age and sex. 

FFM = a* Height 2 /R + b* Weight -c* Age + d*Sex + e 

r> i t~i i aa * Weight - FFM 

BodyFat = 100* 

Weight 

Eq. 1 

In the meantime, if the user selects the calorie consumption measurement menu on 
the diet manager main screen, the heart rate sensor 110 and the body fat sensor 140 of the 



biomedical signal measurement module 100 are activated while a guide message for calorie 
consumption measurement is displayed on the display unit as shown in FIG 24c (S270 and 
S280). 

Then, when the user presses the measurement start button according to the guide 
message while holding the mobile device 400, the heart rate sensor 110 measures PPG 
signals before exercise from the user's body while the body fat sensor 140 measures the body 
impedance from the user's body. After exercise is completed, the heart rate sensor 110 
measures PPG signals from the user's body once more (S290). At this time, the measured 
PPG signals are displayed on the display unit as shown in FIG 24c so that the user can check 
the measurement results, and the status window for indicating the ratio of completion of the 
biomedical signal measurement may also be displayed. 

Then, the measured PPG signals before exercise are analyzed to calculate average 
heart rates before/after the exercise. Calorie consumption due to exercise is calculated 
based on the calculated average heart rates before/after exercise, exercise time, and the user's 
height, weight, age and sex. The calculated calorie consumption is displayed on the display 
unit as shown in FIG 24c (S300 and S3 10). At this time, the calorie consumption can be 
calculated by the following Eq. 2 that is a function of the measured average heart rates (HR*, 
HRb) before/after the exercise, weight and exercise time. 

Calorie consumption (Kcal) = a x { HR* - HRb } x weight x exercise time 

Eq. 2 

where a is an average calorie of a human body in a normal (comfortable) state. 

Next, a case where the user selects the diet history management menu or diet 
information menu on the diet manager main screen of FIG 24a will be described with 
reference to FIG 21. 

If the user selects the diet history management menu on the diet manager main screen, 
diet history management screen, a diet history management screen is displayed as shown in 
FIG 24d (S320 ~ S330). If the user selects a desired term in this state, a diet history is 
displayed on the display unit according to the selected term (S340 and S350). In a state 
where the diet history is displayed on the display unit, if the user selects a comment on a 
specific date, the selected comment is displayed on the display unit (S360 and S370). 

Meanwhile, if the user selects the diet information menu on the diet manager main 
screen, information on a diet is displayed on the display unit as shown in FIG 24e (S3 80 and 
S390). 



As described above, the stress level, the body fat percentage of the user's body and 
the calorie consumption due to exercise can be measured at any time if necessary by using 
the mobile device according to the present invention. 

Although the present invention has been described in connection with the preferred 
embodiment illustrated in the drawings, this is merely illustrative. It will be understood by 
those skilled in the art that various modifications, changes and equivalents can be made 
thereto. In particular, although the present invention has been described by way of example 
in connection with the case where stress is selected among a variety of emotions and the level 
of stress is checked, the health care method of the present invention is not limited thereto but 
can allow the checking of a variety of emotions based on a variety of biomedical signals 
measured by the biomedical signal measurement module. Therefore, the true technical 
scope of the present invention should be defined by the scope of the appended claims, 

[Effects of Invention] 

According to the present invention, the user can conveniently check his/her own 
emotional state and physical condition at any time by using the mobile device. Therefore, 
there is an advantage in that modern people who lack time to care for their health can more 
easily manage their own health condition. 

Further, according to the present invention, there is an advantage in that the users can 
simply check their own emotional state and physical condition through natural operations for 
using the mobile device. 

Moreover, according to present invention, service differentiation can be promoted by 
adding functions, which can greatly interest users, to the mobile device. Therefore, there is 
an advantage in that a manufacturer of the mobile device can obtain increased benefits by 
manufacturing terminals capable of cooperating with a variety of physical condition 
measurement devices. 



